Papers by Niladri S. Chatterji
Compute Optimal Scaling of Skills: Knowledge vs Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Scaling laws are a critical component of the LLM development pipeline, but little is known about whether the COs of individual skills such as mathematical reasoning, question answering (QA) or coding, align with these APEs. |
| Approach: | They examine knowledge-based QA and code generation to find out whether skill-dependent scaling is an artefact of the pretraining datamix. |
| Outcome: | The proposed scaling laws are skill-dependent, and knowledge and code exhibit fundamental differences in scaling behaviour when corrected for datamix differences. |